networking: add connection backoff config options#491
Conversation
Signed-off-by: Alexander Kabakaev <kabakaev@gmail.com>
1348b1e to
35f9324
Compare
|
note: waiting on fluent/fluent-bit#3191 |
|
@esmerel would you mind reviewing this PR? I've nudged the owner on code PR fluent/fluent-bit#3191 which looks ready to merge. |
|
|
||
| ### Connection backoff | ||
|
|
||
| This set of options is designed for large-scale fluent-bit deployments, which may need to limit number of TCP SYN packets in case an output destination is unreachable. By default, fluent-bit will retry connecting to an output target on each chunk flush. But if, for example, `net.initial_backoff=8` and `net.max_backoff=60` options are set, then an output plugin will try to reconnect to a failing output only after a delay of 8, 16, 32 and 60 seconds. Each fluent-bit thread will keep trying only once every 60 seconds, until connection is healthy again. |
There was a problem hiding this comment.
| This set of options is designed for large-scale fluent-bit deployments, which may need to limit number of TCP SYN packets in case an output destination is unreachable. By default, fluent-bit will retry connecting to an output target on each chunk flush. But if, for example, `net.initial_backoff=8` and `net.max_backoff=60` options are set, then an output plugin will try to reconnect to a failing output only after a delay of 8, 16, 32 and 60 seconds. Each fluent-bit thread will keep trying only once every 60 seconds, until connection is healthy again. | |
| This set of options is designed for large-scale Fluent Bit deployments, which may need to limit number of TCP SYN packets in case an output destination is unreachable. By default, Fluent Bit will retry connecting to an output target on each chunk flush. But if, for example, `net.initial_backoff=8` and `net.max_backoff=60` options are set, then an output plugin will try to reconnect to a failing output only after a delay of 8, 16, 32 and 60 seconds. Each Fluent Bit thread will keep trying only once every 60 seconds, until connection is healthy again. |
There was a problem hiding this comment.
Looks generally ok to me as long as my suggestion is applied, but I can't see the conflicts to fix them.
|
@kabakaev can you look at the review suggestions and conflicts so this is ready when code PR fluent/fluent-bit#3191 merges? |
|
@kabakaev as you can see, the conflicts I had to fix resulted in taking the path to a new docs PR. I'll update the code PR to reflect that and your attribution will remain in this new docs PR. I will close this in favor of the new #2590 which will be waiting only on the code PR fluent/fluent-bit#3191 merging. |
This PR can be merged only if the FLB PR 3191 is accepted and merged.